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(54) IMAGE PICKUP DEVICE 
(57)Abstract: 

PROBLEM TO BE SOLVED: To simultaneously record attribute information including 
image pickup position information and video records. 

SOLUTION: A navigation message from a GPS satellite is received by a GPS antenna 
18 and the image pickup position information (longitude, latitude, altitude, date and 
time) is obtained. Those and photographer data from a memory means 24 are 
superimposed on compression-encoded video data and simultaneously recorded in a 
recording medium 34. In such a manner, since GPS information is received and the 
image pickup position information obtained from it is superimposed in video 
information during recording along with the photographer data or the like registered 
beforehand and recorded, the need of inputting the image pickup position information 
and date and time information, etc., by a manual operation after recording video images 



is eliminated. 



* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]An imaging device which has a recording function making as [ record / in the 
state where it was added to video information which attribution information including 
information on an image pickup position obtained by a positioning means is 
picturizing ]. 

[Claim 2]The imaging device according to claim 1, wherein a GPS system is used as 
the above-mentioned positioning means. 

[Claim 3]The imaging device according to claim 1, wherein information which shows 
the above-mentioned imaging place is latitude of an image pickup position, and 
longitude information at least. 



[Claim 4]The imaging device according to claim 1, wherein the above-mentioned 
attribution information is date information, photography person data, etc. besides the 
above-mentioned image pickup position information. 

[Claim 5]The imaging device according to claim 1, wherein the above-mentioned video 
information is made as [ insert / it is compressed based on an MPEG 2 rule, and / in 
user data area provided for any of the sequence layer, a GOP layer, and a picture 
layer being / the above-mentioned attribution information ]. 



2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the imaging device which has a 
recording function. It enables it to perform management of an image material, search, 
etc. easily in detail, as the position information under image pick-up can also be 
recorded at the same time it records the video information under image pick-up. 
[0002] 

[Description of the Prior Art]In an imaging device with a recording function, if the 
attribution information of the image referred to as having carried out "where "whom"" 



inclusion "when" (VTR integral-type video camera etc.) etc. is recordable into 
recorded video image data, management of the recorded image material and search 
will become easy. Since it is expected that an opportunity to search and utilize the 
raw material which more efficient image work was required and was especially 
accumulated in the video data base with multi-channeHzing of the broadcast based 
on digital compression / transmission art increases, the management or retrieving 
operation to a raw material have not been exceeded to an easy thing. Also in order to 
protect copyright on the occasion of raw material employment as an attribute to 
record, a photography person's data, etc. are required. 
[0003] 

[Problem(s) to be Solved by the Invention]By the way, what he is trying to record 
automatically with video information and speech information simultaneously with 
inclusion as attribution information for managing an image material now is a time code, 
a date, and time (date information). About a photography persons, other attribution 
information, for example, image pickup position, etc. information, after the 
administrator of an image material checks the contents after inclusion, it has inputted 
by the manual separately. Therefore, the working efficiency for recording attribution 
information is bad. 

[0004] Mistaken data may be inputted if attribution information is recorded after 
inclusion in this way. Therefore, to be able to perform smoothly from photography to 
construction of a video data base is desired. It is dramatically convenient if the 
various attribution information of a time code, inclusion time, a photography person, an 
image pickup position, etc. is automatically recordable especially simultaneously with 
the recording of the video information under image pick-up. 

[0005]Then, this invention solves such a conventional technical problem, and 
proposes the imaging device which can record simultaneously the various attribution 
information of a photographing date, a photographing location, a photography person, 
etc. into picture image data at the time of inclusion. 
[0006] 

[Means for Solving the Problem]In order to solve an above-mentioned technical 
problem, in an imaging device concerning this invention, it was made as [ record / in 
the state where it was added to video information which attribution information 
including image pickup position information from a positioning means is picturizing ]. 
[0007]In this invention, GPS information is received, and since image pickup position 
information acquired from this is superimposed and recorded into video information 
under inclusion with photography person data etc. which were registered beforehand, 



after recording an image, it is necessary to input neither image pickup position 

information nor date information by manual operation. 

[0008] 

[Embodiment of the Invention]Then, one embodiment of the imaging device 
concerning this invention is described in detail with reference to drawings. 
[0009]It is what established the positioning means which can position an image pickup 
position to an imaging device, and is made to record on the same recording medium 
simultaneously in this invention with an image while recording the positioning 
information (image pickup position information) acquired from this. 
[0010]By this invention, GPS (Global Positioning System) is used as a positioning 
means, The date data and positioning data (the longitude, the latitude, altitude) which 
were detected from this, and the photography person information beforehand 
recorded on the memory are simultaneously recorded in the compression video data 
compressed by MPEG(Moving Picture Experts Group) 2 method. 

[0011]In the imaging device 10 shown in drawing 1 , the object image acquired via the 
optical system 12 is supplied to the image pick-up circuits 14, such as CCD, and is 
changed into a video signal. Compression encoding of the video signal is carried out in 
conformity with MPEG 2 which the image encode circuit 16 was supplied and was 
mentioned above. 

[0012]The GPS system as a positioning means is carried in the imaging device 10, and 
it has the GPS antenna 18. Based on the electric wave sent from two or more artificial 
satellites as everyone knows, a GPS system is a system which searches for the 
position of the addressee of three dimensional space, and is already put in practical 
use in the car-navigation system etc. 

[0013]The electric wave of three or more sets of satellites actually receivable out of 
24 GPS Satellites which turn around an orbit about 21000 km above ground is 
received by the GPS antenna 1 8, and this is supplied to the GPS positioning circuit 20. 
[0014]ln the GPS positioning circuit 20, the coordinates (longitude, latitude, and 
altitude) of a receiving position are computed in real time by computing the distance 
from a satellite by decoding the navigation message of each satellite. According to 
this GPS system, it can position for the whole world and positioning errors are 
15m-100m. 

[0015]The satellite is loaded with the atomic clock and exact current time (at the at a 
day, the time a part, a second) can be acquired from the temporal data in a navigation 
message. [ Being imaging time. ] The coordinate data and date data which were 
detected in the GPS positioning circuit 20 are transmitted to the image encode circuit 



16 at any time in this example. The timing of positioning measurement is also 
measurable at any time during an image pick-up like an upper example, if it can also 
carry out by waiting for the positioning command signal from the control section 60 
which comprised a microcomputer formed in the device. 

[0016]The time of the internal clock 22 in a device is automatically amended based on 
the hour entry acquired from the satellite (reset processing). 

[001 7]In the device 10, the memory means 24 is established further, and the variety of 
information about a photography person is stored here beforehand. As photography 
person information, they are a photography person's name, a belonging section, a 
contact, a video title, etc. The writing of the information on the memory means 24 is 
performed via the input means (a graphic display is not carried out) provided in the 
control section 60 mentioned above. 

[0018]In the image encode circuit 16, with the photography person data led from the 
memory means 24, the coordinate data generated by the positioning means, date data, 
etc. are digital-dataHzed with an MPEG2 system like picture image data, and picture 
image data is overlapped on them. 

[0019]Here, the data structure of MPEG 2 is as drawing 2 . As shown in the figure, 
picture image data has six layered structures of a sequence layer, a GOP (Group of 
Pictures) layer, a picture layer, a slice layer, a macro block layer, and a block layer. 
The top sequence layer describes the screen group of - ream with the same attribute. 
[0020]A GOP layer shows the minimum unit of the screen group who becomes a unit 
of random access. A picture layer describes the attribute common to the screen of 
one sheet. The slice layer expresses information common to the small screen which 
divided the screen of one sheet into arbitrary length, and information common to the 
picture element block which divided the slice layer further in the macro block layer. 
The lowest block layer describes the conversion factor (DCT coefficient) of DCT 
(Discrete Cosine Transform). 

[0021]The video sequence of MPEG 2 is the same as the layered structure mentioned 
above, is the order of a sequence layer, a GOP layer, a picture layer, a slice layer, a 
macro block layer, and a block layer, and is repeatedly described till a sequence end. 
[0022]It will be described by the bit length as which the sequence start 
synchronization code with which it is first expressed in a video sequence was 
beforehand specified to data (image size etc.) common to a sequence as sequence 
header data to the head if it explains with reference to drawing 3 and drawing 4 (Step 
81). 

[0023]Next, sequence extended data, such as a scanning mode beforehand specified 



by MPEG, is described by regulation bit length following an extended data start 
synchronization code and an extended data identification code (Step 82). Furthermore, 
extended data (Sequence Extension) called (1) Sequence Display Extension and (2) 
Sequence Scalable is prescribed by MPEG. It is described in order of (1) and (2) like 
extended data by the bit length beforehand specified after the extended data start 
synchronization code and the extended data identification code if needed. 
[0024]The code corresponding to 1 to 1 is assigned to an extended data identification 
code at each extended data. About the original data which is not specified by MPEG, 
what 8xn bit length describes after an user-datum start synchronization code like 
extended data is allowed. In this invention, coordinates, time, photography person data, 
etc. are described by this user data area (user datum (1)) of the sequence layer 
mentioned above so that it might mention later by 8xn bit length (Steps 83 and 84). 
These descriptive data turn into common data of a sequence unit, and an user-datum 
start synchronization code is assigned in front of a user data area. In the case of 
extended data other than an user datum, an extended data start synchronization code 
and an extended data identification code are added, respectively, and extended data is 
described (Steps 83 and 85). 

[0025]In MPEG, a GOP layer continues after a sequence layer. The GOP data which is 
data about random access is described here. Since GOP data is not indispensable 
requirements, when GOP data does not exist, it changes to the description to the 
picture layer which is a lower layer (refer to Step 86 and drawing 4 ). When describing 
GOP data, GOP header data is described by regular bit length after a GOP start 
synchronization code (Step 87). 

[0026]Although extended data is not specified in a GOP layer at present, insertion of 
the user datum (user datum (2)) of the 8xn bit length following an user-datum start 
synchronization code as well as a sequence layer is allowed (Steps 88 and 89). 
Therefore, if coordinates, time, photography person data, etc. are described in this 
area, the accuracy of GOP units will be guaranteed. Before an user datum (2), an 
user-datum start synchronization code is similarly added with having mentioned above. 
[0027]Following GOP data, as shown in drawing 4 , the data of a picture layer in which 
an attribute common to one screen is shown is described. Also in this case, 
indispensable data (picture type etc.) is described by the head by regular bit length as 
picture header data in a picture start synchronization code at a picture layer (Step 91). 
[0028]To a picture layer, like a sequence layer, (1) Picture Coding Scalable, (2) Quant 
Matrix Extension, (3) Picture Display Extension, (4) PictureSpatial Scalable Extension 
reaches. Five extended data of (5) Picture Temporal Scalable Extension is defined. In 



order of (1) to (5), it is described as picture coding extended data after the extended 
data start code and extended data identification code which show the start of 
extended data (Step 92). Although (1) is an indispensable description, the description 
from (2) to (5) can omit this. 

[0029]It is allowed to insert the user datum of the 8xn bit length following an 
user-datum start synchronization code in the position which can insert extended data 
as an user datum (3) like the layer of a higher rank also in this picture layer (Steps 93 
and 94). It is described by the user datum (3) of this picture layer when the accuracy 
of a screen (picture) unit is called for. 

[0030]The coding data (picture data) in a screen is described after a picture layer. 
Since it is not directly related to this invention, to drawing 4 , have not described those 
details, but. Stroke region description of the data (quantization characteristic etc.) of 
a slice layer, the data (data common to a macro block) of a macro block layer, and the 
data (DCT transformation coefficient) of a block layer is carried out at the order 
specified beforehand (Step 95). 

[0031]The above process is repeated till the end of picture image data by making a 
picture, GOP, and a sequence into a unit (Steps 96-99). The sequence end 
synchronization code which finally shows the end of a sequence at the time of a 
sequence end is described (Step 100). 

[0032] All the area of the layer of the user datum (2) of the layer of the user datum (1) 
of the sequence layers explained above and the GOP layers and the layer of the user 
datum (3) of the picture layers or some area (layer) are used. The attribution 
information of coordinates, time, photography person data, etc. which were mentioned 
above is described. 

[0033]By the layer described in this way, it can respond to the accuracy for which 
search and management of the image are asked, respectively. It is decided with the 
accuracy demanded at the time of reproduction in which hierarchy it inserts. 
[0034]It is inserted in the user data area (1) established in the sequence layer when it 
was a precision prescribe of the sequence unit, If it is a precision prescribe of GOP 
units, it will be inserted in the user data area (2) established in the GOP layer, and it 
will be inserted in the user data area (3) of a picture layer if it is a precision prescribe 
of a picture unit. In insertion to a picture layer, a precision prescribe becomes high 
most. 

[0035]An example of the data structure of the user datum used by this invention is 
shown in drawing 5 . In order to show that the data (attribute data) which this invention 
defined is described following the UDSC code (4-byte composition) which shows the 



start of an user datum, the shot data start synchronization code SDSC as an 
identification code (4-byte composition) is described. 

[0036]In this example, following the SDSC code, latitude data (5-byte composition), 
Each attribute data is described by the turn and data width of longitude information 
(5-byte composition), altitude data (4-byte composition), a date and temporal data (at 
a day and the time, it is 8-byte composition in order to express a part and a second), 
and photography person data (8xn byte composition). Finally, end synchronization 
code SDEC of shot data (4 bytes) which shows the end of an user datum is described. 
[0037]Now, it returns to drawing 1 , and after a sound is collected with the microphone 
26 and changed into an electrical signal, encoding processing of the sound is carried 
out in the voice encode circuit 28, and it is outputted as an audio sequence. After 
being packet-ized in the multiplexing circuit 30, respectively, Time Division 
Multiplexing of this audio sequence and the video sequence having contained the 
picture image data mentioned above and attribute data is carried out. Picture image 
data is actually level, and multiplex [ of the audio information ] is carried out using a 
vertical blanking period. Multiplexing data is written in the archive medium 32 using the 
magnetic tape 34a or the disks (a hard disk, an optical disc, etc.) 34b, after becoming 
irregular in the record circuit 32 (recorded). 

[0038]Simultaneously with this data recording, in order to check the contents of 
record data in this example, The switch 42 for record/reproduction formed in the 
monitor means 40 is controlled at the record side (REC side), and the same data as 
contained data is supplied to the separation circuits 44, and is divided into a video 
sequence and an audio sequence. Then, in the voice decode circuit 46, voice data is 
decoded and the loudspeaker 48 is reproduced. 

[0039]Similarly, although picture image data is reproduced in the image decode circuit 
50 as for a video sequence, attribute data, such as coordinate data, date data, and 
photography person data, is transmitted to the attribute data regenerative circuit 52, 
after separating from picture image data in the image decode circuit 50. Although a 
graphic display is not carried out to the attribute data regenerative circuit 52, the 
character generation circuit and the layout control circuit are established in it, and the 
coordinate data, date data, and photography person data which were decoded are 
character-image-ized. After the acquired character image was changed into the telop 
video signal (character image signal) and it is compounded by the original video signal, 
the screen overlay of it is carried out on the displaying means 54. Therefore, 
attribution information can be checked according to the contents of the displayed 
character. 



[0040] On the other hand, at the time of reproduction, the switch 42 is changed to the 
reproduction side (PB side), and. The record data recorded on the archive medium 34 
gets over in the regenerative circuit 58, and separation and after being decoded, a 
video signal, a telop video signal, and an audio signal are similarly reproduced and 
displayed to have mentioned above. 

[0041] Drawing 6 is an example of processing when attribute data is inserted in the 
user data area (1) in a sequence layer, In this case, a sequence start synchronization 
code (00 00 01B3h) is checked (Step 72), When the user-datum start 
synchronization code UDSC (00 00 01 B-2h) and shot data start code SDSC (FF FF 
FF FFh) are detected following this code detection, (Step 74), Since attribute data will 
be inserted in user data area, decoding of an user datum and video-signal processing 
for telops are performed in this case (Step 76). This telop video signal is overlaid by 
the original video signal after that (Step 78). 

[0042]When attribute data is inserted in a different hierarchy from drawing 6 , the 
hierarchy detection code in Step 72 is only different, and since subsequent processing 
is the same, the detailed explanation is omitted. 

[0043]Control of these series is what is managed by the control section 60 mentioned 
above, Therefore, the various control signals which the control section 60 comprised 
CPU62 which controls the whole processing mentioned above, ROM64 which recorded 
the control procedure, RAM66 which store data indispensable to each processing at 
the time of - etc., and were generated here are suitably sent out to the device main 
frame 1 0A or the monitor means 40. 

[0044]As long as it may unite with device 10 main part, different body composition 
may be sufficient as the monitor means 40 mentioned above. In composition, imaging 
device 10 itself can really be used also as an editing device with an edit function. In 
unification composition, the viewfinder VF of a device can be used as the displaying 
means 54. In different body composition, the control section 60 will be built in at a 
device main frame. 

[0045]Although MPEG 2 was illustrated as an example of the compression encoding of 

picture image data, it does not restrict to this. 

[0046] 

[Effect of the Invention]Automatic moreover, attribution information, such as 
coordinates of an inclusion place, inclusion time, and photography person information, 
is recorded simultaneously with picture image data in picture image data by this 
invention as having explained above. 

[0047]Since the attribution information which included image pickup position 



information simultaneously with an image is recordable according to this, a manual 
input can be abolished. This attribution information by which simultaneous record was 
carried out is widely utilizable as a key to material management and search of picture 
image data. Although image pickup position information is included in attribution 
information, since this image pickup position information can use a GPS system, that 
realization is easy for it. Since there is much photography on the outdoors which is 
easy to receive the electric wave from a GPS Satellite in news coverage etc., it is 
comparatively easy to incorporate image pickup position information. Therefore, it 
uses for management etc. of the news materials in which quick handling is demanded, 
and is suitable. In a broadcast use, since this attribution information can be used as an 
object for automatic generation / sending out of a telop indispensable to explanation 
of an image material, it has the features, like the editing work in a broadcasting station 
becomes very easy. 

[0048]Secondary effects, like by GPS positioning, since a very exact hour entry can 
be acquired, the automatic correction of the internal clock in an imaging device 
becomes possible, and exact time can be recorded are also acquired. 
[0049]Therefore, this invention is applied to an imaging device with the recording 
function for news coverage, etc., and is very preferred. 



2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a distribution diagram of an important section showing one 

embodiment of the imaging device concerning this invention. 

[Drawing 2] It is a layered structure figure of MPEG 2 picture image data. 

[Drawing 3] It is a flow chart (the 1) which shows the example of the video sequence in 

MPEG 2. 

[Drawing 4] It is a flow chart (the 2) which shows the example of the video sequence in 
MPEG 2. 

[Drawing 5] It is user-datum structural drawing. 

[Drawing 6] It is a flow chart which shows the example of attribute data processing. 
[Description of Notations] 

10 ... An imaging device, 10A ... A device main frame, 16 ... Image encode circuit, 18 [ ... 
An archive medium, 40 / ... A monitor means, 52 / ... An attribute data regenerative 
circuit, 54 / ... A displaying means, 60 / ... Control section ] ... A GPS antenna, 20 ... A 
GPS positioning circuit, 24 ... A memory means, 34 



